Modeling Human Sentence Processing with Left-Corner Recurrent Neural Network Grammars

نویسندگان

چکیده

In computational linguistics, it has been shown that hierarchical structures make language models (LMs) more human-like. However, the previous literature agnostic about a parsing strategy of models. this paper, we investigated whether LMs human-like, and if so, which is most cognitively plausible. order to address question, evaluated three against human reading times in Japanese with head-final left-branching structures: Long Short-Term Memory (LSTM) as sequential model Recurrent Neural Network Grammars (RNNGs) top-down left-corner strategies Our modeling demonstrated RNNGs outperformed LSTM, suggesting architectures are plausible than or architectures. addition, relationships between cognitive plausibility (i) perplexity, (ii) parsing, (iii) beam size will also be discussed.

برای دانلود باید عضویت طلایی داشته باشید

برای دانلود متن کامل این مقاله و بیش از 32 میلیون مقاله دیگر ابتدا ثبت نام کنید

اگر عضو سایت هستید لطفا وارد حساب کاربری خود شوید

منابع مشابه

Recurrent Neural Network Grammars

We introduce recurrent neural network grammars, probabilistic models of sentences with explicit phrase structure. We explain efficient inference procedures that allow application to both parsing and language modeling. Experiments show that they provide better parsing in English than any single previously published supervised generative model and better language modeling than state-of-the-art se...

متن کامل

Sentence Modeling with Gated Recursive Neural Network

Recently, neural network based sentence modeling methods have achieved great progress. Among these methods, the recursive neural networks (RecNNs) can effectively model the combination of the words in sentence. However, RecNNs need a given external topological structure, like syntactic tree. In this paper, we propose a gated recursive neural network (GRNN) to model sentences, which employs a fu...

متن کامل

Abstract Left-corner Parsing for Unification Grammars

Left corner Parsing for Uni cation Grammars Noriko Tomuro and Steven L Lytinen DePaul University School of Computer Science Telecommunications and Information Systems S Wabash Ave Chicago IL flytinen tomurog cs depaul edu

متن کامل

Left-corner Parsing Algorithm for Uniication Grammars

iii Acknowledgements Like many Ph.D. graduates will say, writing a thesis and doing the research that comes with it is a solitary business. Fortunately I had many people who gave me kind support and warm encouragement throughout this process. I owe a debt of sincere gratitude to each of those people. First, my advisor Dr. Steve Lytinen, who directed my study which led to this thesis. From day o...

متن کامل

Large-scale neural network for sentence processing.

Our model of sentence comprehension includes at least grammatical processes important for structure-building, and executive resources such as working memory that support these grammatical processes. We hypothesized that a core network of brain regions supports grammatical processes, and that additional brain regions are activated depending on the working memory demands associated with processin...

متن کامل

ذخیره در منابع من


  با ذخیره ی این منبع در منابع من، دسترسی به آن را برای استفاده های بعدی آسان تر کنید

ژورنال

عنوان ژورنال: Shizen gengo shori

سال: 2022

ISSN: ['1340-7619', '2185-8314']

DOI: https://doi.org/10.5715/jnlp.29.253